Detectability of non-differentiable generalized synchrony 
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Generalized synchronization of chaos is a type of cooperative behavior in directionally-coupled os- 
cillators that is characterized by existence of stable and persistent functional dependence of response 
trajectories from the chaotic trajectory of driving oscillator. In many practical cases this function 
is non-differentiable and has a very complex shape. The generalized synchrony in such cases seems 
to be undetectable, and only the cases, in which a differentiable synchronization function exists, 
are considered to make sense in practice. We show that this viewpoint is not always correct and 
the non-differentiable generalized synchrony can be revealed in many practical cases. Conditions 
for detection of generalized synchrony are derived analytically, and illustrated numerically with a 
simple example of non-differentiable generalized synchronization. 
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I. INTRODUCTION 



Synchronization plays an important role both for un- 
derstanding of cooperative behavior in natural networks 
of oscillators Q and for various engineering applica- 
tions 0, Recently a significant interest in un- 
derstanding and theoretical description of synchroniza- 
tion regimes among the oscillators with chaotic behav- 
ior is perceived, see for example recent books and re- 
views 0, H, • Various types of chaos synchrony, whose 
description may require different theoretical frameworks, 
were found in natural systems and specified. These types 
of synchrony include identical synchronization @>la>l^]> 
generalized synchronization 0, ITTl Il2l Il3| and phase 
synchronization |14lll5j . 

The framework of generalized synchronization was pro- 
posed as an attempt to extend the classical theory of 
forced synchronization of a periodic oscillator, initiated 
by the works of van der Pol 0] , Andronov and Witt ; 
to the case of directionally coupled chaotic oscillators. 
This framework defines synchronization as the onset of 
conditional stability of a chaotically driven oscillator, and 
as the existence of a functional relation that maps the 
chaotic trajectory of driving oscillator into the trajectory 
of driven oscillator |ToL ITsj . In the case of invertible dy- 
namics of driving system such functional relation is usu- 
ally substituted with a function that maps the state of 
driving system into the state of response one when these 
states are measured simultaneously. Rigorous mathemat- 
ical results indicate that, depending on the strength of 
conditional stability, the synchronization function can be 

differentiable or non-differentiable [S 113, El |H H| . ^ 

many experimental studies researcher needs to establish 
the fact of chaos synchronization when direct analysis of 
conditional stability is hardly possible. In such a situa- 
tion the detection of generalized chaos synchrony char- 
acterized by a non-differentiable function, which due to 
dense wrinkles, cusps and finite number of points ap- 
pears as a thick and fuzzy set, may seem to be impossi- 
ble minm 



In this paper we show that detectability of the non- 
differentiable synchrony can be significantly improved 
and become feasible if one explores synchronization func- 
tion taking into account additional points on sufficiently 
long intervals of the driving trajectory preceding to the 
current state. The paper is organized as follows. In 
Section |n] we discuss the idea of such detectability and 
evaluate the improvement using numerical analysis of a 
simple example. Section ITTT1 develops a theoretical argu- 
ments explaining the mechanism behind the detectabil- 
ity improvement. Section IIVI discusses possible effects 
caused by small additive noise in the data. Summary of 
the results and possible applications are discussed in the 
Conclusion. 



II. NUMERICAL EXAMPLE 

To illustrate the idea of detectability enhancement 
we first consider an example of a drive-response system 
which was proposed and studied in poj . In this example 
generalized baker map 
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Here parameter c defines the properties of the response 
behavior. Consider the systems dynamics within the pa- 
rameter interval < c < 1. In this case response system 
(J2J) is conditionally stable. The dynamics of driving sys- 
tem (1) is invertible and according to the theory (see, 
for example (2^, ) there exists a continuous function 
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FIG. 1: The shape of the function y n = h(xn) computed 
with c = 0.7. 

y„ = /i(x„), where x„ = (x„\ Xn^)- Due to the spe- 
cific form of the driving and response systems function 

(2) 

h, in our case, is independent of x n ■ Indeed, given the 
value of Xn all previous values of this variable can be 
found from equation Qlap. when one iterates this one- 
dimensional map backward in time, and these values are 

(2) 

independent of x n . Therefore, function h can be plotted 
as a graph in the variables plane (xn\y n ). 

The example of non-differentiable function h computed 
with c = 0.7 is shown in Fig.^ It is clear from the shape 
of the function that, in practical situation with a similar 
function, the existence of the function cannot be revealed 
from such a plot because the states of response system 
measured for nearby states of driving system can be very 
disperse. This situation can make one to believe that the 
onset of non-differentiable generalized synchronization is 
practically undetectable. The statements on such practi- 
cal undetectability are usually made when one analyses 
only relation between simultaneous states in the attrac- 
tors of driving and response systems. One may ask a 
question if additional information about the chaotic tra- 
jectory can help to resolve the complexity of this func- 
tional relation? And if the answer is yes, what properties 
of the non-differentiable function can be improved? 

To illustrate positive answer to the first question we 
adopt the approach developed in [2(| and consider the 
additional information about the driving chaotic trajec- 
tory x„ using its symbolic description. Now we define 
the state of the driving system as the value of x^l m and 
the symbolic sequence [a±, ...,a m ] generated in the next 
consecutive iterations towards x^ . In the considered 
example symbols cti can be easily defined from the evo- 

(2) (2) 

lution of variable x n ■ If x n _ i < a, then = 0. If 

(2) 

x n _ i > a, then on = 1. From the data generated by 
the maps (1), we can examine synchronization func- 



tion in a new form h^ m ^ which is defined as a mapping 
([ai, ...,a m ],x£l m ) -> y„. 

In order to illustrate the improvement of the modified 
synchronization function with the increase of to we 
plot y n versus ([ai, a m ], a;„2 m ) for two fixed symbolic 
sequences that differ by two most recent symbols. The 
cases of m = 4 and m = 8 are presented in Fig. [2^ and 
b respectively, where the parameters of the maps are the 
same as in Fig. Q] Comparing these plots with the plot 
shown in Fig.[T]one can see that the existence of synchro- 
nization function becomes more apparent as the delay m 
increases. Notice, that the scales of corresponding axes 
in these plots are the same. 

We studied how the complex image of synchronized 
attractors in the space of a drive-response system con- 
verges to a "good" simple function with the increase of 
to. We analyzed the sets of attractor points conditioned 
by all possible symbolic masks a of various lengths to. 
For each mask of preceding symbols = [ot\, .., a m ] we 
computed the best polynomial fitting function <p S i (x) of 
order 30 using Singular Value Decomposition (SVD) al- 
gorithm, and studied the dependence of mean squared 
error (Ems), averaged over all masks of length to, on the 
value of to. This dependence computed for four different 
values of c is shown in Fig. |3| 

One can see from Fig. [31 that Ems decreases exponen- 
tially fast when m increases. Approximating this depen- 
dence with exponential, 

EmsM ~ e Am , (3) 

one can find the rate of convergence A. Figure 01 shows 
how the convergence rate A evolves with the change of 
parameter value c. The absolute value of A decreases 
as the value of c grows. This indicates that for higher 
values of c the synchronization function becomes more 
complex [2(j and its detection with a given resolution 
requires more information on the driving trajectory then 
for lower values of c. 

One can easily check that when c — > 1, the conditional 
dynamics of response system (J2J approaches the thresh- 
old of instability and, as the result, synchronization ter- 
minates and function h disappears. The plot of A vs c 
reflects this fact and one can see from Fig. 0] that con- 
vergence rate A tends to zero as c — > 1 . It can be shown 
that the linear dependence of A on log(c) is due to the 
fact that the response system in this example is a linear 
system and log(|c|) is the contraction rate of its phase 
volume. 

To get a better view on the function improvement, 
examine how additional symbolic information collected 
along the driving trajectory changes the shape of the 
whole synchronization function. One way of taking such 
symbolic information into account is to compute the in- 
teger value out of binary symbolic mask S l m and, then, 
supplement this integer with the fractional value given by 
x„l m . Note that in our case < a4_ OT < 1. Computing 
the integer part we assume that the most resent symbol 
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FIG. 2: The synchronization function computed using addi- 
tional symbolic information on the driving trajectory for the 
case shown in Fig0 Only two symbolic masks of each length 
m are presented. The case m = 4 is shown in panel (a) and 
m — 8 is in panel (b). 




FIG. 3: The dependence of mean squared error of best poly- 
nomial fitting function for the attractor points (x n— m-) Vn) on 
the length m of the preceding masks S^. 



0.0 

A 



-0.5 



-1.0 



-1.5 



-2.0 































/ 








































? — 





































































0.1 



1.0 



u\ of mask S l m is the most significant bit. As the result 
we obtain the decimal values of the form I{S l m ).x^}_ rn . 
Every decimal value is considered as a new argument 
of the modified synchronization function h^ m \ Figure 
presents such a function plotted for three different values 
of m. One can see that for large m (m > 4), the over- 
all shape and complexity of the function remains about 
the same, but the interval of the argument increases in 
size by factor 2 m . This indicates that there exists some 
kind of self-similarity of the non-diffcrentiable synchro- 
nization function, and the enhanced detectability is the 
result of more precise evaluation of the state of the driv- 
ing system. It is important to note that the precision 
of the state evaluation increases with m despite the fact 
the values of variable are measured with the same 
precision as before. 



FIG. 4: The dependence of convergence rate A on the value 
of coupling parameter c plotted in the logarithmic scale. 



III. THEORETICAL RESULTS 

The example considered above clearly indicates that 
the functional relation between the synchronized system 
becomes more apparent when length of driving trajectory 
taken for the analysis increases. In order to examine 
which properties of the non-differentiable function change 
and simplify the detection of the functional relation we 
present the following theoretical analysis. 

In this section we shall concentrate on systems with a 
unidirectional coupling (or systems with a skew product 
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FIG. 5: The synchronization function shown in Fig. Q plot- 
ted versus a new variable ul" 1 ' := I^Sl^.x^^^ that contains 
symbolic information about the driving trajectory. Panel (a) 
shows the case m = 4, (b) m — 6, and (c) m = 8. Note the 
changes in the values of the horizontal axes. 

structure) of the form: 

x' = f(x) (4) 

y = g P (x,y). 

These equations determine a map F p : (x,y) i— > (x',y') 
generating a dynamical system. The first subsystem is 
called the driving system, the second subsystem is called 
the response system and p is a parameter that controls 



the coupling strength. The fact of synchronization in this 
systems means that there is a region of parameter values 
p in which, for any initial conditions (xo>J/o)> (xo,yo), 

lim dist(y n ,y n ) = 0, (5) 

n — >oo 

where (x n ,y n ) = F™(x ,y ) ((x n ,y n ) = F"(x ,2/o))- 
Loosely speaking, this means that, for any initial con- 
ditions, the distance between the states of the slave sub- 
system goes to zero with time. 

We assume for the sake of definiteness, that in the 
system Q one has x € M. d and y £ M. e , and that g p is 
continuous and / is a homeomorphism. Since we study 
dissipative systems we also assume that there exists a 
ball of dissipation B C R d+e , i.e. F p (B) C Int(B) for 
any p £ S, where S is a region in p-space (in which 
the system Q exhibits synchronization). Without loss 
of generality we assume that B = B x x B y , i.e. B is a 
rectangle, where B x (resp. By) is a ball in x-space (resp. 
y-space). Denote by A p the maximal attractor in B, i.e. 
A P = D~ F?(B). ' 

Through this section we shall assume that one-to-one 
globally stable generalized synchronization occurs in B, 
i.e. the condition Q satisfy when (xo,yo) and (xo,yo) 
are arbitrary points in B. 

It was shown in |23( that under these conditions there 
is a continuous functional dependence between x and y— 
components of orbits while the system is in synchronized 
region. To obtain more detailed characteristics about this 
functional dependence we need an additional assumption. 
Assume that 

\y n+ i - y n+ i\ < c\y n - y n \ (6) 

where c < 1. Of course the parameter c is a function of p. 
For the sake of simplicity, we assume that c = p. Thus, 

\Vn+l - Vn+l\ < P\Vn -fjn\, < p <1. (7) 

It follows that 

\g P (%,y) -g P (x,y)\ < p\y-y\ (8) 

for any (x, y), (x,y) G B. Let us draw the attention on 
the fact that the smaller p is, the greater the coupling 
strength. 

Assumption (JJJ implies that \y n — y n \ goes to zero ex- 
ponentially fast, and this fact allows one to prove that 
function h : x n >— > y n is Holder continuous provided that 
the functions / and g p have good smooth properties, or at 
least they are Lipschitz-continuous. So we assume that: 

\f(x)-f(x)\< 1+ \x-x\ (9) 

and 

\f-\x)-f-\x)\<'y-\x-x\, (10) 

where 7_,7 + > 1. Here 7+ characterizes the rate of 
divergence of nearby driving trajectories forward in time, 
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and 7_ characterizes their divergence backward in time. 
Moreover, we assume that: 



\a P (x,y) - g p (x,y)\ <<n\x-x\ 

for any (x,y), (x,y) £ B, where 77 > 0. 
The following statement was proved in [2J 



(11) 



Theorem 1 (Holder property) Under assumptions 
the function h is Holder continuous, i.e. for 
any < a < ao, x, x G A PiX one has: 



\h(x) ~ h(x)\ < 2a\x-x\ a 



whe 



a < ao 



1 



log(7 + 7_; 
logp 



(12) 



(13) 



and a > ao, where a — oq is the solution of the equation: 

JJ log(7 + 7_) log\B y 



74 



• a iogp (7+7-) 



Here \B y \ stands for the diameter of B y . Recall 
that Holder exponents quantify the "degree of non- 
diffcrcntiability" . 

Our goal is to understand what happens if one tries to 
study the dependence between the y-coordinate of the 
orbit at iteration n and the x-coordinate at the moment 
n — to, for to > 0. In other words we are going to study 
the effect of the "delay" onto the functional dependence 
in the synchronized region. The following result holds: 

Theorem 2 Let conditions of Theorem^] be satisfied and 
(x n ,yn), ( x n^y'n) be orbits belonging to A p . Then for 
every e > there exists S > such that for every pair 
Xn— m 7 Xfi— jji , |^n— ?7i x ri — m \ <C S one has 



\y n - Vn\ < A\x n -, 

where 

a <a + /3(e), a Q = ^1 - 
and A > A m , where 



log(7 + 7_) 

log/3 



A, n = e + gj_ m 
and g is a constant independent of m. 



(14) 



(15) 



(16) 



Proof. Without loss of generality we prove the esti- 
mate (| X 1 p for n = 0. The proof for another values of n 
is the same. Let A PyX = H X A P be the image of A p under 
the natural projection H^ to Mr. 

Consider a point xq £ A PtX . Let X-i = f~ l (xo). Given 
the backward orbit {x-i}°°^ , the dynamics on B y is de- 
fined by the sequence of operators {g p (x-i, -)}^o acting 
on By. Define the following operation: 

(g P *9p)(x,y) = 9 P (f(x),g P {x,y)) . 



We denote by g* p {x,y) the result of the operation V 
performed k times (by convention g*° = g p ). Notice that 
gf(x,y) = n y F*(x,y). 

Consider two points (xq, yo) and (xq, yo) in the attrac- 
tor, i.e. yo = h(xo), yo — h(xo). Their backward orbits 
up to time k are also contained in the attractor. We 
denote them by: 



(x- k ,y-h), (x-i,y-i), {x ,y ) 



and 



(x^ k ,y-k), . . . , (i_i,y_i), (x ,y ) ■ 
By construction we have that: 



xo = f k (x-k) 

yo - n p 



gf{x- k ,y- k ) 



and 



Xo = f (x-k) 
yo - y p 



gt(x-k,y-k) ■ 



From these equations we can estimate \yo — yo\- Indeed, 
triangle inequality yields: 

bo— yol < \g*p k (x-k,y-k)-g* p k (x-k,y-k)\ + , 17) 
\g P k (x-k,y-k)-g p k (x- k ,y-k)\ 

The first term on the right can be bounded using the 
contracting property of g: 



\gf (x- h ,V- k )-9? (x-k,y-n)\ <p k \By\ 



(18) 



where \B y \ stands for diam(i? y ). The second term can 
be bounded by: 

\g* p k {x- k ,y-k) - gf{i-k,V-k)\ < L k \ X - k -X-k\ , (19) 

where Lk is the Lipschitz constant of <?*(•, y). According 
to Lemma 16 in the paper |2^| 



Lk < 



(20) 



7+ - P 

Using assumption (|10|l one gets: 

\x-k~ x^k\<l k S m \x- m - i^ m \. (21) 
Putting together these inequalities, one obtains for all k: 



n 



7+ - p 



■l- m (7+7-) fe |£- 



\yo-yo\ < P k \B y \ 

— i' 

Fix an arbitrarily small a > and rewrite the first term 
in ll'L'l) as follows 



p k \B y \ = (p + a) k \B y 



p + a 



(23) 
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then set 

{p + a) k °±\x- m -x^ n \ a . (24) 
Therefore using standard logarithmic identity 

(7+7- ) fe =G? fe l°s G (7 + 7-) 
with G = \x- m — x- m \i and formula (|24|l one can write 

( 7+ 7_) fc = \x- m - x- m \ (25) 

Let a = a(a) = (l - ) ■ Then implies 




Thus, if \x- m — X— m \ is small enough then k is large 
enough because of Therefore, (j^f^j \E y \ < e, 

a(er) = ao + /3(e), and the statement of Theorem [3 holds. 
□ 

Hence, we have shown that while the Holder exponent 
remains the same as for m = 0, the Holder constant A m 
given by formula (|16|1 can be as small as we wish pro- 
vided that points on the graph of the function h are close 
enough. In the numerical example presented in Sec.HTltlic 
closeness of driving trajectories was achieved by selecting 
the trajectories with the same symbolic sequence S^. 

IV. EFFECTS OF NOISE 

The studies presented in Sections [H] and IIIII deal with 
the dctectability issues of non-differentiable (wrinkled) 
synchronization function when data, acquired from drive 
and response system, are not contaminated by noise. In 
a realistic situation external noise is always present in the 
data. Taking into account the complexity of fine struc- 
ture typical for wrinkled synchronization functions one 
may expect that even a very small noise in the data ru- 
ins the detectability of synchronization. We studied the 
noise impact using the numerical example considered in 
Section ^ We examined how the convergence of wrin- 
kled function to a polynomial function is effected by 
external noise. 

The behavior of synchronized systems can be influ- 
enced by a noise in many different ways. For example, 
stochastic forces, applied to response and/or drive sys- 
tem, destroy the functional relation between the systems 
independently of the complexity of the function shape. 
The level of destruction in this case will significantly de- 
pend upon the dynamical properties of the coupled sys- 
tems. 

To be specific we will examine only the case when the 
synchronization function exists, but the data represent- 
ing this function are contaminated with a noise added to 
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FIG. 6: The dependence of mean squared error of best poly- 
nomial fitting function for the attractor points (x n - m ,y n ) on 
the mask length m computed for c = 0.7 and four different 
values of variance a\ of the noise added to y n data. 

the measurements. Namely, when one deals with the data 
Xn +£n and Un + Cn, where Xn and y n are generated by 
equations (l),©, and the independent noisy components 
£ ra and are white Gaussian noise with variances ajj and 
cr|j, respectively. In the numerical analysis we will also 
assume that symbolic sequences of driving trajectory are 
detected correctly. 

We found that £„ and £n influence the convergence 
properties differently. To illustrate it, consider, first, the 
cases when only one source of noise in present. Figure 
shows the effect of noise occurred in the measurements 
of the response system (£„ = and Cn ^ 0) for different 
values of variance a^. Noise of this type sets a limit 
on the precision of the function resolution, see Fig. 
The numerical analysis shows that the limit is E^g « 
cr|j. This result is quite predictable. Indeed, noise in 
the response system destroys the function by scattering 
points along y-variable and makes a thick object (a fuzzy 
layer)instead of the graph h^ m \ The thickness of the 
layer is characterized by the level of noise, namely by a\. 
It is clear that, the size of the thickness (along y- variable) 
does not change under the transformations applied to the 
data representing driving trajectory. Since our method 
is not designed to locate the function inside this fuzzy 
layer, we cannot expect the accuracy (in terms of Erm) 
be better than a R . 

When noise occur in the measurements of driving vari- 
able (£„ ^ and £„ = 0) the conversion process has 
a different dynamics, see Fig. [7| Now the graph of the 
function in Fig. ^ is transformed into a thick layer due 
to scattering of data points along variable x. However, 
as it follows from Fig.[7]that thickness does not limit the 
precision of function evaluation. This effect can be un- 
derstood from the considerations presented in Fig.^and 
Fig. [S] Indeed, the increase of trajectory length in the 
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FIG. 7: The dependence of Ems on m computed for c = 0.7 
and four different values of variance a 2 D of the noise added to 

Xfi dcl/fccL. 
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FIG. 8: The dependence of mean squared error of best poly- 
nomial fitting function for the attractor points (x n - m ,y n ) on 
the trajectory length m computed for three different n. 



analysis of the function is equivalent to rescaling of the 
function argument, while the overall shape of the func- 
tion does not change, see Fig. While the interval of 
the argument values increases with the trajectory length 
as 2 m the cc-size of the think layer remains unchange. As 
the result the increase of m, in this case, improves the 
precision function detection. 

The effects induced by additive noise in the data is 
summarized in Fig. |H1 where the dependence of Ems 
versus m is shown for three different situation of noise 
(£„ = 0, Cn + 0), (£„ + 0, Cn - 0) and (£„ £ 0, 
C,i 7^ 0). These plots are computed for the coupling 
strength c = 0.7. The results indicate that if the level 
of noise in the data is small a non-differentiable function 
is detectable with some accuracy limited by the noise 



variance. 

In this analysis we assumed that symbolic sequence 
representing the driving trajectory is detected correctly. 
We expect that when the symbolic sequence contains er- 
rors, then, the function can be severely damaged and, the 
improvement of function detection can fail. We believe 
that the use of a noise reduction technique on the data 
before the computation of Ems versus m plots can be 
very beneficial in this case. 



V. CONCLUSIONS 

A simple numerical example and rigorous theoreti- 
cal analysis show that, despite complex shapes of non- 
differentiable synchronization functions, the existence of 
such a function can be detectable in practical situation. 
This can be achieved by considering this function not as 
a function of the current state of driving system, but as 
a function of the state, in which the driving system has 
been a few steps ago. Thanks to the contracting prop- 
erties caused the dissipation in the driving system the 
nearby trajectories disperse far away from each other in 
the previous times. This effect can be used as a "mag- 
nifying glass" in the detection of non-differentiable syn- 
chronization function that contains multiple wrinkles and 
cusps. It is shown that, although the "magnified" func- 
tion in this analysis remains non-differentiable, the am- 
plitude of these wrinkles and cusps gets smaller as the 
delay increases. 

The results presented in this paper are in agreement 
with the recent study on detecting of generalized syn- 
chrony made by He, Zheng and Stone [23. Their study 
based on a different technique that involves the analysis 
of drive and response trajectories in the embedded phase 
spaces and takes into account p preimages for each tra- 
jectory point. The use of the preimages in this case also 
acts as a " magnifying glass" in detecting of the wrinkled 
synchronization function. 

In the example considered in Section [nj the syn- 
chronization function depends only on the x^-variable, 
which is the coordinate that always represents a stable di- 
rection in x. Stable and unstable direction in the x-space 
in this driving system are fixed and do not dependent on 
x. Therefore, the differential of this map is a constant 
matrix. In a more general situation, this is not the case, 
and the synchronization function must depend on both 
"stable" and "unstable" coordinates. Nevertheless, it is 
possible to understand (although it is not so simple to 
prove) that the dependence on the unstable coordinate is 
non-essential in the hyperbolic situations. The simplest 
way to be convinced is to remember that for hyperbolic 
attractor there exists a local Holder-continuous change 
of variables such that in new variables the stable and un- 
stable directions are along the coordinate lines (planes) 
and the situation becomes very similar to the example 
considered. 

We examined the influence of external noise on the 
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function improvement. We found that noise in the data 
acquired from the response system sets a limit for the 
accuracy of the function approximation and, as the re- 
sult, after some critical value of m the further increase of 
delay becomes useless. 

To conclude we would like to emphasize that, although 
we apply our study to the theory of chaos synchroniza- 
tion, the data analysis method and theory developed here 
can be useful for other applications. Such applications 
include prediction of chaotic dynamical behavior in time 
and space and other studies associated with various types 
of prediction. The use of hybrid, "continuous-symbolic" 
representation of the chaotic trajectories enables one to 
take into account additional information about the tra- 
jectory in a compact way. 
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